chore(several samples) Updating all instances of Pytest up to version 9.0.3 Part II#14231
chore(several samples) Updating all instances of Pytest up to version 9.0.3 Part II#14231XrossFox wants to merge 5 commits into
Conversation
… 9.0.3 Part II to close security alerts from dependabot. Directories that start from C to F. Extra: modified versions on which pipelines are wllowed to rune, since python 9.0.3 only support Python 3.10 onwards, so pipelines will only run 3.10 and 3.14 versions, which are the older and latest versions that are still maintained. Some surrounding packages had it's versions updated to avoid building issues with pip.
There was a problem hiding this comment.
Code Review
This pull request updates the pytest dependency to version 9.0.3 (requiring Python 3.10+) across numerous sample directories and adjusts noxfile_config.py configurations to target Python 3.10 by ignoring other versions. It also updates several Airflow constraints files. The review feedback highlights a critical compatibility issue where upgrading constraints to Airflow 3 in composer/airflow_1_samples will break the Airflow 1.x samples. Additionally, several noxfile_config.py files contain outdated comments referencing older Python versions (such as 3.8, 3.9, or 3.11) as the active test targets, which should be updated to accurately reflect the new Python 3.10 testing environment.
The lowest version supported by pytest is Python 3.10, so all tests should be upgraded to run that at minimum. Python 3.14 and apache beam 2.73 have been released and are both, available on pypi and docker hub. https://pypi.org/project/apache-beam/ |
to close security alerts from dependabot.
Directories that start from C to F.
Extra: modified versions on which pipelines are wllowed to rune, since python 9.0.3 only support Python 3.10 onwards, so pipelines will only run 3.10 and 3.14 versions, which are the older and latest versions that are still maintained.
Some surrounding packages had it's versions updated to avoid building issues with pip.
Notes for specific samples (will be socumented on b/514353082):
Composer samples should be addressed on a different PR, it appears most samples cannot simply be updated due to how Airflow works.
dataflow/custom-containers have docker images that must be updated to run python 3.10, otherwise will only run python 3.9 internally anyways.
dataflow/flex-templates/streaming_beam: same as custom-containers.
Description
Fixes #
Note: Before submitting a pull request, please open an issue for discussion if you are not associated with Google.
Checklist
nox -s py-3.9(see Test Environment Setup)nox -s lint(see Test Environment Setup)